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CLAIMS PENDING AFTER PRELIMINARY AMENDMENT 

1. A person's portrait generation device comprising: 

an image input section which picks up two-dimensional images containing a 
person's face, using an image sensor; 

a head area extracting section which extracts a head area from a differential image 
of a plurality of the two-dimensional images picked up by the image input section; 

a feature detection section which detects position of characteristic features of the 
face within the head area extracted; 

a face outline determining section which determines a border between a face 
outline and a background within the head area; and 

an image processing section which generates a person's portrait in which the 
characteristic features of the face are emphasized based upon the two-dimensional image 
using data acquired by the head area extracting section, the feature detection section, and 
the face outline determining section. 

2. The person's portrait generation device according to claim 1, wherein, in the 
head area extracting section, an outline of the head area is obtained by combining a right- 
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side profile and a left-side profile of the differential image. 

3. The person's portrait generation device according to claim 2, wherein the 
outline of the head area is obtained by eliminating noise components of the right-side 
profile and left-side profile through filtering. 

4. The person's portrait generation device according to claim 2, wherein the head 
area extracting section provides the head area obtained by a rectangular shape in which a 
left side, a right side, and an upper side are determined by the outline of the head area and 
a lower side is determined by a shape ratio constant of an average person's head. 

5. A person's portrait generation device comprising: 

an image input section which picks up a two-dimensional image containing a 
person's face, using an image sensor; 

a head area extracting section which extracts a head area from the image picked up 
by the image input section; 

a feature detection section which detects position of characteristic features of the 
face by dividing the head area extracted into face parts areas for respective face parts and 
finding projection data of binarized images for the respective face parts areas; 

a face outline determining section which determines a border between a face 
outline and a background within the head area; and 

an image processing section which generates a person's portrait in which the 
features of the face are emphasized based upon the two-dimensional image using data 
acquired by the head area extracting section, the feature detection section, and the face 
outline determining section. 

6. The person's portrait generation device according to claim 5, wherein the face 
parts areas are determined by relative positional information of the face parts with respect 
to the head area preliminarily found. 
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7. The person's portrait generation device according to claim 5, wherein the 
position of characteristic features of the face is detected based on a position of a center- 
of-gravity of the projection data. 

8. The person's portrait generation device according to claim 5, wherein the 
position of characteristic features of the face is detected based on a position of a 
maximum value of the projection data. 

9. A person's portrait generation device comprising: 

an image input section which picks up a two-dimensional image containing a 
person's face using an image sensor; 

a head area extracting section which extracts a head area from the image picked up 
by the image input section; 

a feature detection section which detects position of characteristic features within 
the head area extracted; 

a face outline determining section which determines a border between a face 
outline and a background within the head area by specifying a skin color area of the two- 
dimensional image; and 

an image processing section which generates a person's portrait in which the 
characteristic features of the face are emphasized based upon the two-dimensional image 
using data acquired by the head area extracting section, the feature detection section, and 
the face outline determining section. 

10. The person's portrait generation device according to claim 9, wherein the face 
outline determining section determines outline of a jaw. 

11. The person's portrait generation device according to claim 9, wherein, in the 
face outline determining section, the skin color area is determined by converting an RGB 
value to an HSV value. 

12. The person's portrait generation device according to claim 9, wherein, in 
determining the skin color area in the face outline determining section, with respect to an 
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average color near the characteristic features of the face, areas having similar colors are 
used as face area candidates. 

13. A person's portrait generation device comprising: 

an image input section which picks up a two-dimensional image containing a 
person's face using an image sensor; 

a head area extracting section which extracts a head area from the image picked up 
by the image input section; 

a feature detection section which detects position of characteristic features of the 
face for each of face parts within the head area that has been extracted; 

a face outline determining section which determines a border between a face 
outline and a background within the head area; and 

an image processing section which generates a person's portrait in which the 
characteristic features of the face are emphasized by changing the two-dimensional image 
with respect to each of face parts. 

14. The person's portrait generation device according to claim 13, wherein the 
image processing section expresses a person's emotions by changing shape of a partial 
image at each of an eye portion, a nose portion, and a mouth portion that are the 
characteristic features of the face. 

15. The person's portrait generation device according to claim 13, wherein the 
image processing section replaces partial images at an eye portion, a nose portion, and a 
mouth portion that are characteristic features of the face. 

16. A communication terminal comprising: 

an image input section which picks up two-dimensional images containing a 
person's face using an image sensor; 

a head area extracting section which extracts a head area from a differential image 
of a plurality of the two-dimensional images picked up by the image input section; 

a feature detection section which detects position of characteristic features of the 
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face within the head area extracted; 

a face outline determining section which determines a border between a face 
outline and a background within the head area; and 

an image processing section which generates a person's portrait in which the 
characteristic features of the face are emphasized based upon the two-dimensional image, 
using data acquired by the head area extracting section, the feature detection section, and 
the face outline determining section, wherein the person's portrait is transmitted and 
received through a communication unit. 

17. The communication terminal according to claim 16, wherein, in the head area 
extracting section, an outline of the head area is obtained by combining a right-side 
profile and a left-side profile of the differential image. 

18. The communication terminal according to claim 1 7, wherein the outline of the 
head area is obtained by eliminating noise components of the right-side profile and left- 
side profile through filtering. 

19. The communication terminal according to claim 17, wherein the head area 
extracting section provides the head area obtained by a rectangular shape in which a left 
side, a right side, and an upper side are determined by the outline of the head area and a 
lower side is determined by a shape ratio constant of an average person's head. 

20 A communication terminal comprising: 

an image input section which picks up a two-dimensional image containing a 
person's face using an image sensor; 

a head area extracting section which extracts a head area from the image picked up 
by the image input section; 

a feature detection section which detects position of characteristic features of the 
face by dividing the head area extracted into face parts areas for respective face parts and 
finding projection data of binarized images for the respective face parts areas; 

a face outline determining section which determines a border between a face 
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outline and a background within the head area; and 

an image processing section which generates a person's portrait in which the 
characteristic features of the face are emphasized based upon the two-dimensional image 
using data acquired by the head area extracting section, the feature detection section, and 
the face outline determining section, wherein the person's portrait is transmitted and 
received through a communication unit. 

21 . The communication terminal according to claim 20, wherein the face parts 
areas are determined by relative positional information of the face parts with respect to 
the head area preliminarily found. 

22. The communication terminal according to claim 20, wherein the position of 
characteristic features of the face is detected based on a position of a center-of-gravity of 
the projection data. 

23. The communication terminal according to claim 20, wherein the position of 
characteristic features of the face is detected based on a position of a maximum value of 
the projection data. 

24. A communication terminal comprising: 

an image input section which picks up a two-dimensional image containing a 
person's face using an image sensor; 

a head area extracting section which extracts a head area from the image picked up 
by the image input section; 

a feature detection section which detects position of characteristic features within 
the head area extracted; 

a face outline determining section which determines a border between a face 
outline and a background within the head area by specifying a skin color area of the two- 
dimensional image; and 

an image processing section which generates a person's portrait in which the 
characteristic features of the face are emphasized based upon the two-dimensional image 
using data acquired by the head area extracting section, the feature detection section, and 
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the face outline determining section, wherein the person's portrait is transmitted and 
received through a communication unit. 

25. The communication terminal according to claim 24, wherein the face outline 
determining section determines outline of a jaw. 

26. The communication terminal according to claim 24, wherein, in the face 
outline determining section, the skin color area is determined by converting an RGB 
value to an HSV value. 

27. The communication terminal according to claim 24, wherein, in determining 
the skin color area in the face outline determining section, with respect to an average 
color near the characteristic features of the face, areas having similar colors are used as 
face area candidates. 

28. A communication terminal comprising: 

an image input section which picks up a two-dimensional image containing a 
person's face using an image sensor; 

a head area extracting section which extracts a head area from the image picked up 
by the image input section; 

a feature detection section which detects position of characteristic features of the 
face for each of face parts within the head area that has been extracted; 

a face outline determining section which determines a border between a face 
outline and a background within the head area; and 

an image processing section which generates a person's portrait in which the 
characteristic features of the face are emphasized by changing the two-dimensional image 
with respect to each of face parts, wherein the resulting person's portrait is transmitted 
and received through a communication unit. 

29. The communication terminal according to claim 28, wherein the image 
processing section expresses a person's emotions by changing shape of a partial image at 
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each of an eye portion, a nose portion, and a mouth portion that are the characteristic 
features of the face. 

30. The communication terminal according to claim 28, wherein the image 
processing section replaces partial images at an eye portion, a nose portion, and a mouth 
portion that are characteristic features of the face. 

3 1 . A person' s portrait generation method comprising: 

picking up two-dimensional images containing a person's face using an image 

sensor; 

extracting a head area from a differential image of a plurality of the two- 
dimensional images picked up; 

detecting position of characteristic features within the head area extracted; 

determining a border between a face outline and a background within the head 
area; and 

creating a person's portrait in which the characteristic features of the face are 
emphasized based upon the two-dimensional image, using output data obtained in 
extracting the head area, detecting position of characteristic features, and determining the 
border. 

32. The person's portrait generation method according to claim 31, wherein, in 
extracting the head area, an outline of the head area is obtained by combining a right-side 
profile and a left-side profile of the differential image. 

33. The person's portrait generation method according to claim 32, wherein the 
outline of the head area is obtained by eliminating noise components of the right-side 
profile and left-side profile by filtering. 

34. The person's portrait generation method according to claim 32, wherein 
extracting the head area provides the head area in a rectangular shape in which a left side, 
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a right side, and an upper side are determined by the outline of the head area, and a lower 



35. A person's portrait generation method comprising: 

picking up a two-dimensional image containing a person's face using an image 

sensor; 

extracting a head area from the image picked up; 

detecting position of characteristic features of the face by dividing the head area 
extracted into face parts areas for respective face parts and finding projection data of 
binarized images for the respective face parts areas; 

determining a border between a face outline and a background within the head 
area; and 

creating a person's portrait in which the characteristic features of the face are 
emphasized based upon the two-dimensional image, using data acquired in extracting the 
head area, detecting position of the characteristic features and determining a border. 

36. The person's portrait generation method according to claim 35, wherein the 
face parts areas are determined by relative positional information of the face parts with 
respect to the head area preliminarily found. 

37. The person's portrait generation method according to claim 35, wherein the 
position of characteristic features of the face is detected based on a position of a center- 
of-gravity of the projection data. 

38. The person's portrait generation method according to claim 35, wherein the 
position of characteristic features of the face is detected based on a position of a 
maximum value of the projection data. 

39. A person's portrait generation method comprising: 

picking up a two-dimensional image containing a person's face using an image 

sensor; 



side is determined by a shape ratio constant of an average person's head. 
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extracting a head area from the image picked up; 

detecting position of characteristic features within the head area extracted; 

determining a border between a face outline and a background within the head 
area by specifying a skin color area of the two-dimensional image; and 

creating a person's portrait in which the characteristic features of the face are 
emphasized based upon the two-dimensional image, using data acquired in extracting the 
head area, detecting position of the characteristic features, and determining a border. 

40. The person's portrait generation method according to claim 39, wherein, in 
determining a border, the outline of a jaw is determined. 

41. The person's portrait generation method according to claim 39, wherein, in 
determining the border, the skin color area is determined by converting an RGB value to 
an HSV value. 

42. The person's portrait generation method according to claim 39, wherein, in 
determining a border, determining, with respect to an average color in the vicinity of the 
characteristic features of the face, areas having similar colors as face area candidates. 

43. A person's portrait generation method comprising: 

picking up a two-dimensional image containing a person's face using an image 

sensor; 

extracting a head area from the image picked up; 

detecting position of characteristic features of the face for each of the face parts 
within the head area that has been extracted; 

determining a border between a face outline and a background within the head 
area; and 

creating a person's portrait in which the characteristic features of the face are 
emphasized by changing the two-dimensional image with respect to each of the face 



parts. 
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44. The person's portrait generation method according to claim 43, wherein, 
changing shape of a partial image at each of an eye portion, a nose portion, and a mouth 
portion that are the characteristic features of the face in treating the person's portrait to 
express the person's emotions. 

45. The person's portrait generation method according to claim 43, wherein, in 
treating the person's portrait, replacing partial images at an eye portion, a nose portion, 
and a mouth portion that are the characteristic features of the face. 

46. A communication method using a communication terminal comprising: 
picking up two-dimensional images containing a person's face using an image 

^ sensor; 

extracting a head area from a differential image of a plurality of the two- 
dimensional images picked up; 

detecting position of characteristic features within the head area extracted; 
determining a border between a face outline and a background within the head 

area; 

creating a person's portrait in which the characteristic features of the face are 
emphasized based upon the two-dimensional image, using output data obtained in 
extracting the head area, detecting position of characteristic features, and determining the 
border; and 

when a communication is received, the person's portrait thus created is displayed 
so as to inform a user of receipt of the communication. 

47. A communication method using a communication terminal comprising: 
picking up a two-dimensional image containing a person's face using an image 

sensor; 

extracting a head area from the image picked up; 

detecting position of characteristic features of the face by dividing the head area 
extracted into face parts areas for respective face parts and finding projection data of 
binarized images for the respective face parts areas; 
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determining a border between a face outline and a background within the head 

area; 

creating a person's portrait in which the characteristic features of the face are 
emphasized based upon the two-dimensional image, using data acquired in extracting the 
head area, detecting position of the characteristic features, and determining a border; and 

when a communication is received, the person's portrait thus created is displayed 
so as to inform a user of receipt of the communication. 

48. A communication method using a communication terminal that comprises: 
picking up a two-dimensional image containing a person's face using an image 

sensor; 

extracting a head area from the image picked up; 

detecting position of characteristic features within the head area extracted; 

determining a border between a face outline and a background within the head 
area by specifying a skin color area of the two-dimensional image; 

creating a person's portrait in which the characteristic features of the face are 
emphasized based upon the two-dimensional image, using data acquired in extracting the 
head area, detecting position of the characteristic features, and determining a border; and 

when a communication is received, the person' s portrait thus created is displayed 
so as to inform a user of receipt of the communication. 

49. A communication method using a communication terminal that comprises: 
picking up a two-dimensional image containing a person's face using an image 

sensor; 

extracting a head area from the image picked up; 

detecting position of characteristic features of the face for each of the face parts 
within the head area that has been extracted; 

determining a border between a face outline and a background within the head 

area; 
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creating a person's portrait in which the characteristic features of the face are 
emphasized by changing the two-dimensional image with respect to each of the face 
parts; and 

when a communication is received, the person's portrait thus created is displayed 
so as to inform a user of receipt of the communication. 

50. A recording medium in which is recorded a person's portrait generation 
program for execution by a computer, and comprising: 

a head area extracting program for extracting a head area of a person from a 
differential image of a plurality of two-dimensional images picked up by an image input 
section; 

a feature detection program for detecting positions of characteristic features of the 
person's portrait by dividing the head area into face parts areas for respective face parts, 
finding projection data of binarized images for the respective face parts areas and 
detecting the position of each of the face parts based upon a center-of-gravity position of 
the projection data; 

a face outline determining program for determining a border between a face 
outline and a background within the head area by specifying a skin color area of the two- 
dimensional image; and 

an image processing program for creating a person's portrait in which the 
characteristics in the person's face are emphasized by changing the two-dimensional 
image with respect to each of the face parts. 
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